Search results

hunt-crawler

a web crawler based on crawlee, use file to cache result. Easy to maintain as Singleton Service.

• crawl
• web
• crawler
• nodejs

sunkey

published 1.1.0 • 9 months agopublished 1.1.0 9 months ago

@mendable/firecrawl-js

JavaScript SDK for Firecrawl API

• firecrawl
• mendable
• crawler
• web
• scraper
• api
• sdk

hello_sideguide

published 0.0.16 • 11 hours agopublished 0.0.16 11 hours ago

osmosis

Web scraper for NodeJS

• web
• scraper
• crawler
• html
• xml
• dom
• parser

rchipka

published 1.1.10 • 5 years agopublished 1.1.10 5 years ago

simple-node-site-crawler

A simple node module to crawl a domain and generate a page list.

• crawler
• node
• web
• tools

mirite

published 0.3.8 • a year agopublished 0.3.8 a year ago

cheerio-crawler

Web site crawler using cheerio to scan HTML documents

• crawler
• scraper
• html
• cheerio
• web

reykjavikingur

published 1.1.1 • 5 years agopublished 1.1.1 5 years ago

octopus-web-crawler

Another web crawler.

• node
• nodejs
• web
• html
• spider
• crawler
• web-crawler
• scrapper
• data
• mining

chemagares

published 1.1.0 • 3 years agopublished 1.1.0 3 years ago

hotfetch

Scrape pages and extract data in ease

• scrape
• fetch
• crawler
• parser
• web
• dom

samehelalfi

published 2.1.9 • 2 years agopublished 2.1.9 2 years ago

@headwall/url-crawler

URL crawler for analysing web content

• spider
• crawl
• web

headwall

published 0.2.7 • 8 months agopublished 0.2.7 8 months ago

arachnida

Makes it easy to scrape the web for specific information.

• web
• scraper
• html2json
• crawler

jibstaman

published 0.3.1 • 6 years agopublished 0.3.1 6 years ago

email-crawler

"a service for scraping emails from a webpage, given the number of levels to reach

• email
• crawler
• web
• scraper
• spider
• extractor

jackconsidine

published 1.0.4 • 6 years agopublished 1.0.4 6 years ago

get-set-fetch

web crawler, parser and scraper with storage capabilities

• web
• crawler
• spider
• parser
• scraper

a1sabau

published 0.3.8 • 6 years agopublished 0.3.8 6 years ago

@toctive-com/hotfetch

Scrape pages and extract data in ease

• scrape
• fetch
• crawler
• parser
• web
• dom

samehelalfi

published 2.1.9 • 2 years agopublished 2.1.9 2 years ago

url-to-docs

A simple web crawler with a cli suitable for downloading online html documentation.

• documentation
• docs
• html
• crawl
• web
• web-crawler

johnschoeman

published 0.0.0 • 2 years agopublished 0.0.0 2 years ago

bot-or-not

A user agent parser that determines whether a request is from a robot, crawler, spider, etc.

• useragent
• user
• agent
• bot
• robot
• crawler
• spider
• web
• link
• checker
• validator
• feed
• reader
• parser

ramumb

published 0.1.2 • 6 years agopublished 0.1.2 6 years ago

web-crawljs

simple web crawler

• web
• crawler

kayslay

published 2.2.3 • 5 years agopublished 2.2.3 5 years ago

node-red-contrib-web-content-analyzer

Node-RED nodes for web content analysis

• node-red
• web
• content
• analysis
• crawler
• scraper
• image
• text
• page

madjarx

published 1.0.2 • 5 months agopublished 1.0.2 5 months ago

ejoyx-osmosis

Web scraper for NodeJS

• web
• scraper
• crawler
• html
• xml
• dom
• parser

toanz

published 1.1.2 • 7 years agopublished 1.1.2 7 years ago

ejoy-osmosis

Web scraper for NodeJS

• web
• scraper
• crawler
• html
• xml
• dom
• parser

toanz

published 1.1.4 • 7 years agopublished 1.1.4 7 years ago

spindel

A web crawler/spider

• spider
• crawler
• web
• www
• hyperlinks
• links
• crawl

joakimbeng

published 2.0.2 • 8 years agopublished 2.0.2 8 years ago

web-fetch

Asset Crawler for common Web pages

• asset
• crawler
• browser
• web

tech_query

published 1.3.3 • 6 months agopublished 1.3.3 6 months ago